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Divided for each note in a range 
of a musical instrument 
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^ NUMBERS AND KINDS OF MUSICAL INSTRUMENTS 



INITIA L SETTING j cHORD PROGRESSIONS (DESIGNATED OR AT RANDOM) 
I COLOR VARIATIONS (DESIGNATED OR AT RANDOM) etc. 
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OBTAIN CURRENT IMAGE DATA FROM CAMERA 
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EXTRACT "MOVEMENT" 
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Brightness of the last image (or the background 
image registered in advance) is compared with 
brightness of the current image by each pixel. 
If the difference in the brightness is a specified 
value (settable) or more, the pixel is determined 
to have changed. 
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COLORIZE THE PIXEL WHICH WAS 
DETERMINED TO HAVE MOVEMENT 
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CALCULATE POSITION AND 
AMOUNT OF "MOTION" 



Different atmospheres can be produ- 
ced depending on kinds of colors and 
various expressions such as repeated 
cobring or change of color. 



AMOUNT OF MOVEMENT 



The frame is divided in a horizontal direction 
by the number of the musical instruments, 
and in each of the divided sections the 
position of the center of gravity of the 
brightness in the group of pixels that were 
determined to have movement is calculated. 
Simultaneously, the amount of movement Is 
calculated by counting the pixels that were 
determined to have movement. 
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CHORD 

PROGRESSION 



PRODUCE MIDI DATA FROM POSITION 
AND AMOUNT 



The sound Is varied 
in response to rapid 
change or active 
movement. 



MOVEMENT IS JUDGED 
TO HAVE CEASED 
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CHANGE OF SCENE 
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A note is determined in a sound range of each 
musical instrument based on the position of the 
y-coordinate of the center of gravity in the frame 
divided in a horizontal direction. Then, a sound 
in a designated chord is chosen in accordance 
with the musical theory, thereby generating 
comfortable music. 

Volume is determined based on the amount of 
change. 

Right and left sound balance is determined 
based on the position of the x-coordinate. 
In addition, each MIDI parameter is determined 
based on the position in the frames divided in a 
vertical direction, the amount of change, etc. 
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TRANSMIT MIDI SIGNAL TO EXTERNAL MIDI 
OR MIDI SOFTWARE 
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DISPLAY ON SCREEN 
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GENERATE SOUND FROM SPEAKER 
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